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(54) Abstract Title 

Data input using fingerprint sensing device 



(57) A user data input device comprises a fingerprint sensor capable of sensing the surface relief of human 
skin, a movement detector responsive to variation of the output of the sensor to detect motion of skin across 
the sensor and interface apparatus responsive to the movement detector to alter its state in correspondence to 
the detected movement. 

The device may be used to control cursor movement in a menu-based display. 

The fingerprint sensor may comprise an array of optical, force, temperature or conductivity detectors. 

The data input device may find use with mobile telephones, cameras, computers, personal organisers, 
cash dispensers and door entry systems. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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SENSING DATA INPUT 

This invention relates to sensing data input, especially sensing input of movement 
and/or pointing data by means of a sensor such as a fingerprint sensor. 

One important way of making electronic equipment easier to use is to make 
operation of the equipment's user interface more intuitive. To this end, many 
electronic devices have graphical and/or menu-driven user interfaces. In those user 
interfaces options are displayed on a screen and can be scanned through or selected 
on the basis of the movement of a pointer. The pointer may be a cursor which is 
displayed, or may be a virtual pointer which is not displayed but can be considered 
by a user to be conceptually linked to the operation of the display (for example in the 
scrolling of a menu list). Input means is then provided for detecting inputs from a 
user that can cause movement of the pointer. Such input means preferably detect 
physical movement of part of the user's body, whereupon the pointer can be caused 
to move in a corresponding way. A number of types of such input means are 
currently preferred. For detecting motion in one dimension there are rotatable 
wheels or rollers linked to rotation sensors. For detecting motion in two dimensions 
there are mice and trackballs including multiple rotation sensors, trackpoints having 
multiple force sensors, joysticks having multiple sensors for detecting angular 
deflection, and touchpads which can determine the location of a pressure source 
such as a fingertip within the boundaries of the touchpad and over time establish the 
motion of the pressure source within those boundaries. An array of buttons or keys, 
suitably marked with direction arrows, can also be used. 

These forms of motion detection all have disadvantages, especially for highly 
portable equipment such as mobile telephones. Where equipment is intended to be 
highly portable it is greatly desirable that it is small and light-weight and, to improve 
reliability, that it has no moving parts. Wheels, rollers, trackballs, mice and joysticks 
must be large enough to be conveniently engaged by a user's hand and have moving 
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parts and rotation or other detectors that are easily disrupted by dirt that can 
accumulate during use. Dirt is a particular risk for items such as mobile telephones 
that are carried continually and often exposed to dusty or dirty environments. 
Trackpoints are highly compact but are difficult for some users to operate because 
the user's finger engaged on the trackpoint does not change position significantly 
during use. Touchpads can be found to be easier to operate because the user's 
finger must move across the surface of the touchpad in order to provide an input. 
Touchpads have therefore become popular for large-sized items of portable 
equipment such as laptop computers. However, touchpads are generally unsuitable 
for smaller devices such as modem mobile telephones because of the space needed 
to provide room on the touchpad for a finger to be able to be moved within its 
boundaries. With a touchpad, sensed movement is dependant principally on the 
location of pressure on the pad. Buttons and keys occupy a relatively large amount 
of space on a device and are less intuitive for users to operate than are other more 
tactile input means. Also, joysticks, mice, rollers and rollerballs are not capable of 
conveniently sensing rotating motion. 

There is therefore a need for an improved means for control of user interfaces. 

According to one aspect of the present invention there is provided a user input device 
comprising: a sensor capable of sensing surface relief of human skin; a movement 
detector responsive to variation of the output of the sensor for detecting movement of 
skin across the sensor; and user interface apparatus responsive to the movement 
detector to alter its state in correspondence to the detected movement. 

According to another aspect of the present invention there is provided a method of 
operation in a user input device comprising a sensor capable of sensing surface relief 
of human skin, the method comprising: detecting movement of skin over the sensor; 
and altering the state of user interface apparatus in response to the detected 
movement. 
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The sensor suitably comprises a plurality of sensing units. The sensing units are 
preferably arranged in a substantially planar array. The sensing units may be optical 
sensing units or sensing units of another type. The sensor may be a fingerprint , 
sensor. The sensor is preferably capable of detecting surface relief of a depth of 1 or 
2 :m or less. 

The movement detector is preferably responsive to variation of the output of the 
sensor for determining the direction of movement of skin over the sensor. Most 
preferably the sensor comprises a first sensing section extending in a first direction 
and a second sensing section extending in a second direction. One or both of the 
sensing sections may comprise a linear arrangement of sensing units. The first and 
second directions are preferably orthogonal. The movement detector is preferably 
operable to compare successive outputs from the first sensing section to detect 
movement in the first direction and to compare successive outputs from the second 
sensing section to detect movement in the second direction. The movement detector 
is preferably operable to determine a composite direction of movement over the 
sensor from combination of detected movement in the first and second directions. 
The movement detector is preferably operable to detect movement by detecting 
changes over time in the relief detected by parts of the sensor. 

The device suitably comprises storage apparatus capable of storing successive 
outputs from the sensor in a memory so as to form a record of the surface relief of 
skin drawn over the sensor. That record may represent a fingerprint scan. 

The user interface apparatus may include a display and a display controller capable 
of controlling the display so as to cause at least part of an image to move over the 
display in correspondence to detected movement over the sensor. The said at least 
part of an image may be a cursor, and icon or one or more menu options. The 
display controller may be capable of controlling the display so as to cause the said at 
least part of an image to move over the display in apparently the same direction as 
the detected movement over the sensor. For example, if the sensor is in 
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substantially the same plane as the display then those directions of 
movement may be substantially the same. 

The present invention will now be described by way of example with reference to the 
accompanying drawings, in which 

figure 1 shows schematically the architecture of a communication terminal; 

figure 2 illustrates a fingerprint sensor; 

figure 3 illustrates modes of operation of a user interface of the mobile 
telephone of figure 1; 

figure 4 is a cross-section of a fingerprint sensor; and 

figure 5 is a flow diagram showing one example of the operation of the user 
interface of the mobile telephone of figure 1; 

The communication terminal of figure 1 includes a fingerprint sensor 5 which is 
capable of sensing the surface relief of an object over it. The fingerprint sensor is 
connected to detector circuitry 12 which is capable of detecting the direction of 
motion of an object across the fingerprint sensor by comparing two or more 
successive outputs from the sensor. The detector can generate a signal at 13 
indicative of the detected direction of motion. That signal is input to control processor 
3 of the terminal. Control processor 3 then interprets that signal appropriately, as a 
user input For example, the control processor 3 may cause motion of a cursor on 
the display in a corresponding direction to the detected movement. 

The mobile terminal of figure 1 comprises an antenna 1 connected to a radio 
interface 2 for transmission and reception of signals from a radio network. A control 
processor 3 is connected to the radio interface whereby the control processor may 
provide the radio interface with data for transmission to the network, and may receive 
data from the network via the radio interface. The control processor is connected to 
input and output apparatus of the terminal, including keypad 4, fingerprint sensor 5, 
microphone 6, loudspeaker 7 and visual display 8. The control processor is capable 
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of receiving inputs from the input devices 4, 5 and 6 and providing outputs to the 
output devices 7 and 8. 

The fingerprint sensor 5 is shown in more detail in figure 2. The sensor comprises a 
primary linear array 10 of around 256 optical or contact sensors (e.g. sensors 11) 
located closely together, and a secondary linear array 1 1 of around 20 less closely 
spaced sensors disposed orthogonally to the primary array. Each sensor is 
connected to detector circuitry shown schematically at 12 which can generate an 
output signal at 13. Output 13 is connected to the control processor 3. The primary 
array is capable of sensing the detailed shape of a linear section of an object in 
contact with it by means of the level of light incident on, the degree of contact with, 
the force on, temperature at or conductivity to each of the sensors of the primary 
array. The control circuitry is arranged to periodically scan the sensors to receive 
their outputs and thereby periodically generate an output signal indicative of the 
surface relief pattern sensed by the primary array. The outputs from the sensors 
may be sensed digitally as one of a finite number of levels - for example 2, 4, 8 or 16 
levels. Successive signals generated in this way can be stored - so as to build up an 
image of the shape of an object passing over the sensors - or compared, along with 
data from the secondary array - so as to determine the direction of movement in the 
plane of the arrays of an object passing over the sensors. Data resulting from the 
primary array and the secondary array are included in the output signal at 13. 

The sensor may be capable of detecting surface relief of an object lying over it and/or 
that is swept over it. 

The fingerprint sensor may be the FingerChip FC15A140 available from Thomson- 
CSF. Other designs of fingerprint sensor may be used. 

In one mode of operation a user can slide his fingertip over the primary array as 
illustrated at 14 in figure 2. The secondary array allows the sliding motion of the 
user's finger over the array to be detected when successive outputs from the 
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secondary array are compared. By storing successive signals from the 
primary array as the user's finger slides over the fingerprint sensor, the control 
processor can build up an image of the user's fingerprint. That image can be stored 
by the control processor 3 in a memory 9. The stored image can then be checked 
against subsequent scans for use in authentication of operations of the terminal for 
security purposes. The period between successive scans may be fixed at around 
1.5ms, for example, or may be dependant on the rate of movement detected by the 
secondary array as determined at detector circuitry 12. The same principle may be 
used to scan the surfaces of other objects than fingertips. In this mode of operation 
the signal at 13 that is output by the detector circuitry comprises information defining 
the scanned image. 

In another mode of operation the fingerprint sensor of the mobile terminal of figure 1 
can be used in conjunction with detector circuitry 12 and control processor 3 to detect 
motion of a user's fingertip across the sensor. That motion may be used to help 
control the user interface of the phone. Successive outputs of the primary and 
secondary array are taken frequently and compared by detector circuitry 12. The 
period between successive samples of the arrays may be, for example, 2ms or less. 
For greater accuracy more than two successive output scans may be compared. 
Detector circuitry 12 stores successive outputs. Detector circuitry 12 then analyses 
successive outputs with the aim of identifying similar features in them. The distance 
by which such features have moved between the scans in the axis of the primary and 
secondary arrays can then be determined. Those distances can be combined as 
vectors to determine the composite direction of motion of the fingertip across the 
sensor. The rate of movement can also be determined using detector circuitry 12's 
knowledge of the time between successive scans. The same principle can be used 
to determine the direction of movement over the sensors of other objects than 
fingertips. In this mode of operation the signal at 13 that is output by the detector 
circuitry comprises information defining the direction and rate of movement of the 
object over the sensor. 
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The required mode of operation is indicated to the detector circuitry 12 by 
control processor 3 over connection 13a. 

The fingerprint sensor is, of course, capable of detecting surface relief of other body 
parts or other objects than fingertips. The fingerprint sensor is preferably capable of 
sensing surface relief digitally. The fingerprint sensor is preferably capable of 
sensing surface relief at a resolution of less than 0.1mm, more preferably less then 
0.05mm and most preferably less than 0.01mm. A preferred sensor pitch is around 
50:m. 

Figure 3 illustrates some modes of operation of the user interface of the mobile 
terminal. 

• In figure 3a display 8 of the terminal shows a column listing a number of options 
20. A cursor 21 highlights one of the options. In order to select one of the 
options a user applies inputs to the terminal to cause the cursor to move up or 
down to another option, or to cause the options to move up and down through the 
cursor, until the desired option is highlighted. The user then applies an input to 
the terminal to indicate that the desired option has been highlighted. A similar 
principle can be used with left/right motion to offer the user a row of options or a 
two dimensional array of options. 

• In figure 3b display 8 of the terminal shows a cursor 25 and icons 26 distributed in 
two dimensions Each icon represents an option. In order to select one of the 
options a user applies inputs to the terminal to cause the cursor to move up, 
down, left or right until it lies over the icon corresponding to the desired option. 
The user then applies an input to the terminal to indicate that the desired option 
has been highlighted. 

• In figure 3c display 8 of the terminal shows two options 29: one on the right and 
the other on the left of the display. The user makes a single input indicating 
which of those options is desired. 
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In the mobile terminal of figure 1, the fingerprint sensor can be used to help the 
user to select one of the displayed options. When the user is to select an option the 
control processor 3 is arranged to show the appropriate image on the display of the 
mobile terminal. The control processor then signals the detector circuitry 12 to 
indicate that the circuitry should operate to interpret data from the fingerprint sensor 
so as to detect motion over the sensor. When such motion is detected by the 
detector circuitry 12 it is signalled to the control processor 3 to allow the user 
interface to be controlled in a corresponding manner. For example, in the situation of 
figure 3a, up and down motion across the fingerprint sensor (as illustrated at 32 and 
33) may cause the options to scroll correspondingly up or down or the cursor to move 
correspondingly up or down. In the situation of figure 3b, motion across the 
fingerprint sensor may cause corresponding motion of the cursor (as illustrated at 36 
and 37). In the situation of figure 3c, leftward motion across the fingerprint sensor 
may cause the left option to be selected and rightward motion across the fingerprint 
sensor may cause the right option to be selected. Other arrangements may, of 
course, be used. In order to improve the usability of the user interface it is preferred 
that the motion of parts of the image on the display corresponds to the motion 
detected by the motion sensor, for example by appearing to a user to be the same 
direction as or otherwise intuitively liked to the detected motion. 

In some user interface arrangements, for example those of figures 3a and 3b, in 
addition to making inputs to indicate motion a user must also make an input to 
indicate selection of an option. One way to permit this is my means of input from a 
selection button or key on the mobile terminal. Such a button may be part of a 
normal keypad of the terminal and separate from the fingerprint sensor. Another way 
to permit this is by means of input, for example a sudden input such as a finger tap, 
to the fingerprint sensor itself. This may be detected by the fingerprint sensor or by 
another input device attached to the fingerprint sensor. To detect such input by 
means of the fingerprint sensor itself the detector circuitry 12 may be arranged to 
sense a sudden change in the output from the sensor indicative of the sudden 
application of an object over the sensor and in response thereto to provide a 
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selection signal to the control processor 3. To detect such input by use of another 
input means the arrangement in figure 4 may be used. In figure 4 the fingerprint 
sensor 40 is mounted on a push-switch 41. Sensor 40 and switch 41 provide inputs 
to detector circuitry 12. When fingerprint sensor 40 is tapped the switch 41 is 
operated, and in response thereto detector circuitry 12 provides a selection signal to 
the control processor 3. Switch 41 preferably provides an audible and/or tactile 
feedback to a user - for example by means of domed membrane 42 which can 
deform suddenly to the configuration shown at 43 when pressed. 

Figure 5 illustrates an example of the operation of the mobile terminal of figure 1. At 
step 50 a user turns on the terminal using power key 33 (figure 1). The processing 
equipment of the terminal is booted up (step 51). The control processor 3 displays a 
log-in screen on display 8 and signals to the detector circuitry 12 that it should 
operate in fingerprint input mode (step 52). The user swipes his fingertip over the 
fingerprint sensor 5. Detector circuitry 12 forms an image of the user's fingerprint 
from combination of successive signals from the fingerprint sensor and transmits that 
image to control processor 3 (step 53). Control processor 3 compares that image to 
a stored image of the authorised user's fingerprint (step 54) and if there is sufficient 
match allows access to further functions of the terminal (step 55). Otherwise, further 
access is denied (step 56). The control processor then displays a cursor and icons 
representing options distributed over display 8 as illustrated in figure 3b and signals 
to detector circuitry 12 that it should operate in motion input mode (step 57). The 
user moves his finger over the fingerprint sensor in order to move the cursor (by 
means of detector circuitry 12 and control processor 3) correspondingly until it lies 
over a desired icon (step 58). The user then lifts his finger off the fingerprint sensor 
and taps it briefly to indicate selection of that icon, and as a result detector circuitry 
sends a selection signal to control processor 3 which performs the action associated 
with that icon (step 59). This process can continue in order to operate the functions 
of the terminal. 
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Movement detected by the fingerprint sensor may be interpreted by the control 
processor in a way that does not cause corresponding movement of an item on the 
display. For example, up and down motion over the fingerprint sensor during a 
terminal call could cause the earpiece volume of the terminal to increase or decrease 
respectively. 

The fingerprint sensor may be supplemented by other means of user input to the 
control processor. Additional input means could include a keypad, for instance 
including numeric keys for dialling purposes, and/or a microphone for receiving voice 
input from a user. The voice input could be for input of speech during voice terminal 
calls and/or for voice activation of options if the mobile terminal is equipped with 
voice recognition apparatus. 

The operating methods and apparatus described above can be applied to equipment 
other than mobile terminals. 

One notable advantage of the input arrangement described above is that because 
the fingerprint sensor is capable of sensing the relief of an object (especially the 
small scale surface relief of an object) it allows for an especially compact motion 
input device. The above input arrangement can be contrasted in particular to a 
touchpad. A touchpad is capable of sensing motion of an object only within the 
boundaries of the touchpad; therefore the touchpad must be large enough to 
accommodate such movement. In the above arrangement, because the surface 
relief of an object moving across the sensor can be sensed, the sensor can be of 
comparatively small size. Thus unlike with a touchpad the input arrangement of the 
present invention is not limited to providing motion detection principally in 
dependence on the location of an object on the sensor - in contrast, motion 
detection is essentially independent of the location of an object on the sensor, and 
dependant on the detected motion of its surface relief across the sensor. The 
present invention is therefore particularly advantageous when applied to equipment 
that is of small size, such as user portable equipment. 
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Another notable advantage of the above input arrangement is that the sensor may be 
used for reading of fingerprints (or other body parts) as well as sensing motion. The 
sensor and its associated circuitry may therefore have a security function as well as a 
more conventional input function. The present invention is therefore especially 
advantageous when applied to equipment that is preferred to have a degree of 
security, when the fingerprint sensor can provide a means of allowing relative 
security of access to the functions of the equipment. Such equipment may be 
equipment that is capable of making a debit to a user's account and/or equipment 
that provides access to confidential information. Examples of equipment to which the 
present invention may be applied include cameras, person computers, personal 
organisers, cash dispensers and door entry systems. 

Another point to note is that the above input arrangement is capable of sensing a 
rotating motion of a finger or the like over the sensor. This could usefully provide 
convenient data input, especially in conjunction with a corresponding visual display, 
for example to simulate turning of a key in a lock as the user's finger rotates 
substantially about a point. 

The applicant draws attention to the fact that the present invention may include any 
feature or combination of features disclosed herein either implicitly or explicitly or any 
generalisation thereof, without limitation to the scope of any of the present claims. In 
view of the foregoing description it will be evident to a person skilled in the art that 
various modifications may be made within the scope of the invention. 
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1. A user input device comprising: 

a sensor capable of sensing surface relief of human skin; 

a movement detector responsive to variation of the output of the sensor for 
detecting movement of skin over the sensor; and 

user interface apparatus responsive to the movement detector to alter its state 
in correspondence to the detected movement. 

2. A device as claimed in claim 1 or 2, wherein the sensor comprises a plurality of 
sensing units arranged in a substantially planar array. 

3. A device as claimed in claim 2, wherein the sensing units are optical sensing 
units. 

4. A device as claimed in any preceding claim, wherein the sensor is a fingerprint 
sensor. 

5. A device as claimed in any preceding claim, wherein the movement detector is 
responsive to variation of the output of the sensor for determining the direction of 
movement of skin across the sensor. 

6. A device as claimed in any preceding claim, wherein the sensor comprises a first 
sensing section extending in a first direction and a second sensing section extending 
in a second direction, and the movement detector is operable to compare successive 
outputs from the first sensing section to detect movement in the first direction and to 
compare successive outputs from the second sensing section to detect movement in 
the second direction. 
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7. A device as claimed in claim 6, wherein the movement detector is 
operable to determine a composite direction of movement across the sensor from 
combination of detected movement in the first and second directions. 

8. A device as claimed in any preceding claim, including storage apparatus capable 
of storing successive outputs from the sensor in a memory so as to form a record of 
the surface relief of skin drawn across the sensor. 

9. A device as claimed in any preceding claim, wherein the user interface apparatus 
includes a display and a display controller capable of controlling the display so as to 
cause at least part of an image to move across the display in correspondence to 
detected movement across the sensor. 

10. A device as claimed in claim 9, wherein the display controller is capable of 
controlling the display so as to cause the said at least part of an image to move 
across the display in apparently the same direction as the detected movement across 
the sensor. 

11. A device as claimed in any preceding claim, wherein the sensor is capable of 
sensing relative rotation of skin and the sensor. 

12. A user input device substantially as herein described with reference to the 
accompanying drawings. 

13. A communication terminal comprising a user input device as claimed in any 
preceding claim. 

14. A method of operation in a user input device comprising a sensor capable of 
sensing surface relief of human skin, the method comprising: 

detecting movement of skin over the sensor; and 
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altering the state of user interface apparatus in response to the detected 
movement. 

15. A method of operation in a user input device substantially as herein described. 
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